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ABSTRACT 

Gammon  is  a  computer  program  which  plays  Backgammon.      It 
was  developed  to  investigate  a  concept  of  strategy  as  an  integrating 
and  driving  force  in  the  play  of  the  game.     A  strategy  is  defined  and 
implemented  as  a  set  of  tactics  where  each  tactic  is  a  specific  feature 
of  play.      Moves  are  generated  and  evaluated  on  the  basis  of  the  degree 
to  which  they  accomplish  the  objectives  of  the  tactics  making  up  the 
current  strategy.     Strategies  are  selected  and  changed  during  the 
course  of  a  game  by  heuristic  analysis  of  the  current  game  situation. 
Deductive  learning  mechanisms  are  employed  to  improve  the  program's 
performance,    against  both  human  and  virtual  machine  opponents. 
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I.       INTRODUCTION 

A.  PURPOSE 

This  thesis  describes  an  investigation  into  the  use  of  strategies 
in  a  game-playing  computer  program.     The  vehicle  for  the   study  was 
Gammon,    a  program  which  plays  Backgammon. 

The  research  was  motivated  by  four  related  factors. 

1.  The  study  of  game   strategies  had  not  been  a  major 
objective  of  previous  game-playing  programs. 

2.  Because  Backgammon  play  is  characterized  by  the 
existence  of  several  traditional  and  well-defined  styles  or  strategies, 
it  was  especially  suited  to  the   study. 

3.  Experiments  in  machine  learning  could  focus  not  only 
on  the  play  of  a  given  individual  strategy,    but  on  the  process  of 
selecting  a  strategy  as  well. 

4.  To  the  author's  knowledge  Backgammon  had  not  yet  been 
programmed  for  play  on  a  computer. 

B.  GENERAL  CHARACTERISTICS 

Gammon  has  these  principal  characteristics: 

1.  The  concept  of  strategy  is  central  to  the  organization 
and  operation  of  the  program.     The  program  analyzes  the   game 
situation,    chooses  an  appropriate  strategy,    and  selects  the  move 
most  consistent  with  the  definition  of  that  strategy. 

2.  The  basic  logic  of  the  program  is  that  of  goal -fulfillment. 
Strategies  are  defined  operationally  as  sets  of  tactics  or  game 
features.     Each  tactic  has  an  objective,    the  achievement  of  which 


is  the  sole  purpose  of  the  mechanism  which  generates  and  evaluates 
moves.      Unlike  many  other  game-playing  programs,    Gammon  does 
not  construct  and  search  a  game  tree. 

3.  Gammon  assesses  the  consequences  of  proposed  moves 
by  incorporating  into  its  evaluation  process  an  estimate  of  the  prob- 
able net  worth  of  men  captured  or  threatened. 

4.  Gammon  improves  its  performance  through  a  learning 
mechanism  whereby  a  human  "tutor"  evaluates  and  supplements  the 
responses  of  the  program  during  the  course  of  play. 

5.  The  program  operates  in  either  an  interactive  or  batch 
environment,    and  requires  approximately  100K  bytes  on  an  IBM 
360/67  (TSS).      It  was  written  in  PL/I. 

C.      SUMMARY  OF  RESULTS  AND  CONCLUSIONS 

In  general,    the  validity  of  the   strategy  concept  was  verified  by 
the  performance  of  the  program. 

The  strategies  employed  by  the  program  were  designed  to  emulate 
the  traditional  Backgammon  styles  of  play.     The  play  of  Gammon 
generally  conformed  to  these  traditional  styles,    but  lacked  consist- 
ency.    The  uneveness  of  play  was  particularly  noticeable  when  the 
learning  mechanism  was  employed  intensively  at  one  stage  of  a 
game,    without  being  balanced  at  other  stages. 

Perhaps  the  most  serious  weakness  observed  was  the  frequent 
inability  of  the  program  to  capitalize  on  potentially  highly  favorable 
situations  or  to  avoid  potentially  highly  dangerous  ones.     These 
critical  situations  were  usually  short-range  in  nature,    that  is, 
existent  only  over  a  span  of  a  few  moves. 


Thus,    the  strategy  concept  developed  for  Gammon  was  generally- 
satisfactory  in  terms  of  the  long-range  or  overall  character  of  its 
play,    but  generally  inadequate  with  respect  to  recognizing  and  ex- 
ploiting critical  short-range  objectives. 

Suggested  improvements  include  refining  the  existing  mechanisms 
for  generating  and  evaluating  moves,    defining  new  tactics,    and 
providing  the  capability  to  identify,    store,    and  retrieve  generalized 
critical  board  situations  for  use  as  temporary  objectives. 

The  processing  time  required  by  Gammon  was  reasonable.      The 
average  response  time  at  the  terminal  for  a  move  cycle  was  less  than 
a  minute.     The  CPU  time  required  for  a  complete  game  in  the  batch 
mode  was  approximately  one  minute. 


II.   BACKGROUND 

Artificial  intelligence  research  is  concerned  with  constructing 

computer  programs  which  exhibit  behavior  that  is  called  "intelligent 

behavior"  when  observed  in  human  beings.      Within  this  field,    game 

playing  has  been  both  a  favorite  and  prominent  endeavor. 

Game  playing  has  many  fascinating  aspects  to  the 
researcher.     Effectively,    it  provides  a  direct  contest 
between  man's  wit  and  machine  wit.      On  a  more 
serious  level,    game  situations  provide  problem  envir- 
onments which  are  relatively  highly  regular  and  well 
defined,    but  which  afford  sufficient  complexity  in 
solution  generation  so  that  intelligence  and  symbolic 
reasoning  skills  play  a  crucial  role.     In  short,    game 
environments  are  very  useful  task  environments  for 
studying  the  nature  and  structure  of  complex  problem- 
solving  processes  [Ref.    1]. 

To  date,  programs  have  been  written  for  a  variety  of  games  in- 
cluding chess,  checkers,  Go,  Nim,  Kalah,  and  bridge.  Common  to 
many  of  these  programs  are  certain  principal  features. 

All  programs  have  some  kind  of  scheme  for  evaluating  or  measur 
ing  the  "goodness"  of  the  move,    play,    or  board  configuration  under 
consideration.      Perhaps  the  most  widely  used  technique  is  that  of  the 
linear  scoring  polynomial,    which  has  the  form 

S  =  C,X,     +     C0X0  +  .  .  .    +  C     X    . 
11  Z    2  n      n 

The  X's  usually  represent  the  value  of  some  feature  of  play  such  as 
control  of  certain  key  board  positions,    the  capture  of  an  enemy  piece, 
or  the  presence  of  a  certain  geometrical  configuration  of  pieces.      The 
C's  are  weighting  coefficients  which  usually  indicate  the  desirability 
of  that  particular  feature. 
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Another  common  device  is  the  game  tree.     All  two-person  zero- 
sum  games  (of  which  chess,    checkers,    and  backgammon  are  examples) 
can  be  conceived  of  in  terms  of  a  tree  structure  which  represents  all 
possible  sequences  of  moves.     The  main  problem    is  one  of  assigning 
values  to  the  nodes  of  the  tree  and  of  searching  for  a  "best"  path.     A 
common  technique  is  to  explore  the  tree  to  certain  depth,    use  the 
scoring  technique  to  assign  values  at  these  points  and  then  "back  up" 
the  score.     That  is,    work  the  scores  of  the  highest  valued  moves  up 
through  the  tree  to  the  present  position.     The  well  known  checkers 
program  of  Samuel  uses  this  technique  [Ref.    2], 

The  complete  game  tree  is  almost  always  much  too  large  to  be 
stored  or  manipulated  in  any  present  day  computer.     Thus  the  require- 
ments of  practicality  have  given  rise  to  sets  of  powerful  heuristics 
for  "pruning"  the  tree,    or  in  some  way  reducing  the  dimensions  of 
the  solution  space  to  be  searched.      It  is  the  nature  of  heuristics  that 
they  are  not  always   successful,    but  the  necessity  for  having  them  has 
resulted  in  some  of  the  most  inventive  and  brilliant  programming. 

Another  basis  of  organizing  a  game -playing  program  is  the  use 

of  goals,    features  of  the  game  which  it  is  desirable  to  attain  during 

the  course  of  play.      The  chess  program  of  Newell,    Shaw,    and  Simon 

uses  this  approach  [Ref.    3].     Their  program  uses  a  set  of  goals  which 

are  conceptual  units  of  chess,    for  example,    King  safety,    material 

balance,    and  control  of  the  center.      For  each  goal  there  are  three 

routines  associated  with  it:     (1)  a  move  generator  that  finds  moves 

positively  related  to  carrying  out  the  goal;  (2)  a  procedure  for  making 

a  static  evaluation  of  any  position  with  respect  to  the  goal;  (3)  an 

analysis  move  generator  that  explores  the  game  tree  in  order  to 
determine  the  possible  consequences  of  a  move. 


Many  game -playing  programs,    representing  as  they  do  a  well 
defined  subsystem  of  thought,    are  developed  to  explore  the  capabilities 
of  the  machine  to  exhibit  learning  behavior.      Generally,    learning 
mechanisms  can  be  grouped  into  three  types:  deductive,    inductive, 
and  discovery.     In  the  deductive  method  the  programmer  fixes  the 
weights— the  coefficients  of  the  scoring  polynomial-- and  the  character- 
istics to  be  measured -- the  X's.      In  the  inductive  approach  the  program- 
mer fixes  the  characteristics,    but  the  coefficients  are  generated  and 
adjusted  at  run  times.     Both  the  characteristics  and  weights  are 
generated  at  run  time  using  the  discovery  method.      The  Newell-Shaw- 
Simon  program  is  deductive,    while  Samuel's  program  is  inductive. 
BOGART  [Ref.    4],    a  more  generalized  game  player  and  problem 
solver,    uses  the  discovery  method  when  playing  Tic-tac-toe  by  analyz- 
ing and  generalizing  on  geometrical  configurations  of  the  board. 

A  prominent  feature  of  many  games,    but  one  that  has  been  absent 
from  virtually  all  game  playing  programs,    is  the  concept  of  strategy. 

Samuel,    in  the  second  report  [Ref.    5]  on  his  checkers  program, 

states: 

The  chief  defect  of  the  program  in  the  recent  past, 
according  to  several  checker  masters,    seems  to  have 
been  its  failure  to  maintain  any  fixed  strategy  during 
play.      The  good  player  during  his  own  play  will  note 
that  a  given  board  situation  is  favorable  to  him  in 
some  one  respect  and  perhaps  unfavorable  in  some 
second  respect,    and  he  will  follow  some  fairly  con- 
sistent policy  for  several  moves  in  a  row.      In  general 
he  will  try  to  maintain  his  advantage  and  at  the  same 
time  to  overcome  the  unfavorable  aspect.      In  doing     . 
this  he  may  more  or  less  ignore  other  secondary 
properties  which,    under  different  circumstances, 
might  themselves  be  dominant.      The  program,    as 
described,    treats  each  board  situation  as  a  new  problem. 

However,    in  the  same   report  Samuel  sugges  ts  an  approach  to 

strategy  not  unlike  that  developed  for  Gammon.     Samuel  recognized 
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that  the  linear  polynomial  method  of  scoring  moves  suffered  the  dis- 
advantage of  assumed  linear  relationships  between  measured  character- 
istics and  the  desirability  of  a  move.      In  an  attempt  to  correct  this 
weakness  Samuel  employed  what  he  calls  "signature  tables.  "     These 
tables,    in  fact,    are  a  technique  for  measuring  the  contribution  to  a 
move  score  of  the  interaction  among  members  of  sets  of  features. 
According  to  Samuel: 

A  possible  mechanism  for  introducing  this  kind  of 
strategic  planning  is  provided  by  the  signature 
table  procedure  and  by  the  plausibility  analysis. 
It  is  only  necessary  to  view  the  different  signature 
types  as  different  strategic  elements  and  to  alter 
the  relative  weights  assigned  to  the  different  signature 
types  as  a  result  of  the  plausibility  analysis  of  the 
initial  board  situation.      For  this  to  be  effective, 
some  care  must  be  given  to  the  groupings  of  the 
parameters  into  the  signature  types  so  that  these 
signature  types  tend  to  correspond  to  recognizable 
strategic  concepts.      Fortunately,    the   same  initial- 
level  grouping  of  parameters  that  is  indicated  by 
interdependency  considerations   seems  to  be  reason- 
able in  terms  of  strategies.      We  conclude  that  it  is 
quite  feasible  to  introduce  the  concept  of  strategy  in 
this  restricted  way. 

Samuel  subsequently  abandoned  this  approach,    suggesting  that  the 
disappointing  results  were  due  to  ".  .  .    the  ineffectual  arrangement  of 
terms  into  usable  strategic  groups.  ..." 

With  this  background  in  mind,    the  overall  design  of  Gammon  can 
be  placed  in  a  more  clear  perspective.      First,    the  method  of  generating 
and  evaluating  moves  in  Gammon  is  clearly  more  similar  to  the  ap- 
proach of  Newell,    Shaw,    and  Simon,    than  to  the  game  tree  technique. 
However,    Gammon  uses  a  set  of  features,    i.e.  ,    a  strategy,    as  a 
goal,    and  employs  move  generators  and  evaluators  at  the  component 
level.     The  risk  evaluator  of  Gammon  performs  a  similar  function  as 

the  analysis  generators  of  Newell,    Shaw,    and  Simon  in  assessing  the 
consequences  of  a  proposed  move. 
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The  concept  of  a  strategy  as  a  logical  grouping  of  game  features, 
as  suggested  by  Samuel,    is  developed  more  fully  in  Gammon.      In  the 
latter,   however,    the  intent  is  not  to  develop  an  improved  scoring 
technique,    but  to  give  operational  definitions  to  the  styles  of  play  or 
strategies  traditional  to  the  game  of  Backgammon.     In  Chapter  IV  this 
concept  will  be  described  in  more  detail,    but  at  this  point  a  brief  look 
at  the  game  of  Backgammon  is  in  order. 
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III.       THE  GAME  OF  BACKGAMMON 

Backgammon  is  one  of  the  oldest  of  board  games,    having  been 
known  to  the  Greeks  and  Romans  of  ancient  times  and  praised  by 
Chaucer  and  Shakespears.      It  is  still  a  popular  pastime  in  the 
Mediterranean  area.     The  game  enjoyed  a  resurge  of  popularity  in 
this  country  during  the   1930' s  when  certain  variants  of  the  game 
increased  its  attractiveness  as  a  kind  of  parlor  gambling  game.     A 
variant  of  the  game,    "Acey-'Deucey",    remains  popular  in  the  U.    S. 
Navy. 

Belonging  to  the  class  of  "military"  board  games,    along  with 
chess  and  checkers,    Backgammon  is  a  game  of  retreat.      Opposing 
forces  are  deployed  in  the  field  with  the  objective  being  to  move  them 
safely  through  the  counter-retreating  enemy  to  one's  "home"  and 
thence  off  the  board. 

The  figure  below  depicts  the  board,    the  initial  positions,    and  the 
direction  of  movement. 

The  game  is  played  on  a  board  divided  into  two  halves,    or  tables, 
by  a  perpendicular  strip  called  the  bar.      Extending  from  the  sides 
nearest  the  players  toward  the  center  are  alternately  colored  narrow 
triangles,    or  points,    to  and  from  which  the  men  move.     The  points 
are  usually  referred  to  by  number,    each  player's  points  numbered 
from  12  to  1  from  his  outer  to  inner  table.     Each  player  has   15  men, 
usually  white  or  red  for  one  player  and  black  for  the  other.     A  pair  of 
dice  completes  the  necessary  equipment. 

A  play  is  made  in  Backgammon  by  moving  a  man,    or  men,    as 
many  points  as  there  are  pips  on  the  thrown  dice.      If  doublets  are 
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Outer  Table 


White's 
Outer  Table 


Black's 
Inner  Table 


White's 
Inner  Table 


Figure  1.    Backgammon  Board 
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thrown,    the  player  moves  twice  the  number  of  points  indicated.      In 
playing  a  throw  the  number  on  each  die  is  played  separately,    not  the 
total  as  a  single  number. 

In  moving  a  man  around  the  board  a  player  cannot  move  a  man  to 
a  point  on  which  two  or  more  of  the  opponent's  men  are  resting.     Such 
a  point  is  called  a  "held"  or  "made"  point. 

If  a  player  moves  to  a  point  occupied  by  only  one  opponent  (a 
single  man  is  termed  a  "blot")  that  man  is  called  "hit"  and  is  taken 
out  of  play  by  placing  it  on  the  bar.      On  the  opponent's  next  play, 
before  he  can  move  any  other  men,    all  of  his  men  on  the  bar  must  be 
brought  back  on  the  board  by  entering  them  in  his  opponent's  inner  table 
on  the  points  corresponding  to  the  dice  roll.     A  man  hit  must  thus 
start  his  journey  all  over  again. 

The  objective  of  the  game  is  to  move  all  of  one's  men  around  the 
board  and  into  his  inner  table  while  at  the  same  time  impeding  the 
progress  of  his  opponent  as  much  as  possible.      Once  all  of  a  player's 
men  are  in  his  inner  table  he  begins  the  final  operation,    known  as 
"bearing  off".     This  consists  of  removing  men  from  the  inner  table 
and  off  the  board  according  to  the  throws  of  the  dice.     The  first 
player  to  do  this  wins  the  game. 

A  unique  feature  of  Backgammon  is  the  existence  of  several 
traditional  strategies  or  styles  of  play. 

1.      The  Position  Game.     This  is  perhaps  the  fundamental 
strategy  of  Backgammon.      It  is  the  cautious,    conservative  game  in 
which  one  lets  the  opponent  take  the  bold  risks  while  you  occupy  key 
points,    expose  as  few  men  as  possible,    bring  up  your  rear-most 
men  at  every  safe  opportunity,    and  keep  alert  for  advantageous 
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circumstances  to  switch  to  another  strategy.      Position  is  the  strategy 
usually  adopted  for  the  early  stages  of  the  game. 

2.  The  Running  Game.     This  style  of  play  is  more  aggressive, 
in  which  the  object  is  to  get  as  many  men  "home",    i.  e.  ,    into  one's 
own  inner  table  as  expeditiously  as  possible.      One  accepts  a  higher 
risk  in  this  game,    although  it  can  also  be  played  defensively,    with 
more  concern  for  exposed  men.     This  strategy  is  frequently  adopted 
when  one  has  an  early  advantage  because  of  fortuitous  dice  rolls.      It 

is  also  a  common  strategy  for  use  near  the  end  game  when  all  or 
most  of  one's  men  have  passed  safely  by  the  last  opponent. 

3.  The  Blocking  Game.     The  object  of  this   game  is  to  erect 
a  block  or  "side  prime"  of  six  consecutive  points,    thereby  trapping 
the  opponent's  men  in  front.     Ideally,    the  block  is  then  advanced  a 
point  or  two  at  a  time,    continuously  impeding  the  progress  of  the 
opponent.     The  blocking  strategy  requires  that  the  disposition  of  one's 
men  make  the  construction  of  a  block  possible.      Given  these  conditions 
the  block  is  a  powerful  weapon,    although  it  is  more  typically  used 
when  one  is  behind. 

4.  The  Back  Game.     This  is  the  strategy  of  desparation,    to 
be  used  only  when  one  is  far  behind  in  a  game.      In  some  respects  it 
is  a  special  case  of  the  blocking  game,    in  that  the  object  is  to  build  a 
block  in  or  near  the  opponent's  inner  table,    while  continually  hitting 
his  blots  whenever  possible,    and  at  the  same  time  exposing  any  of 
your  advanced  men  so  that  they  may  be  hit  and  hence  brought  on  the 
board  near  where  the  back  block  is  being  erected.      It  is  a  very  dif- 
ficult game  to  carry  off  successfully  but  is  sometimes  the  only 


recourse, 
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5.      Bearing  Off.     This  is  the  end-game  of  Backgammon  in  which 
men  are  withdrawn  from  the  board.      Under  no  threat  of  capture  the 
object  is  to  get  as  many  men  off  the  board  with  as  few  rolls  of  the 
dice  as  possible.      If,    however,    the  opponent  has  some  deep  runners 
or  men  still  on  the  bar,    the  bearing  off  process  must  be  balanced 
against  the  precaution  of  not  exposing  men  to  capture.     Hence  there 
are  distinct  offensive  and  defensive  end-game   strategies. 

References  6  through  8  contain  complete  descriptions  of  the 
rules  and  strategies  of  Backgammon. 
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IV.       DESCRIPTION  OF  THE  PROGRAM 

A.      GENERAL 

As  a  computer  program,    Gammon  has  two  significant  character- 
istics:    It  is  modular  in  design  and  operation,    and  the  same  set  of 
modules  can  be  used  for  either  interactive  or  batch  execution. 

The  modular  approach  was  adopted  in  order  to  be  able  to  call 
one  module  from  within  several  other  modules.      Moreover,    because 
of  the  large  size  of  the  program,    the  ability  to  design,    write,    compile, 
test,    and  execute  it  as  logically  separate  entities  was  a  practical  as 
well  as  organizational  necessity. 

Each  module  is  described  in  detail  in  Appendix  C,    but  it  is  ap- 
propriate to  list  here  the  major  functions  performed  by  the  program 
as  a  whole.     These  functions  are: 

1.  To  implement  the  various  commands,    options,    and  moves 
entered  at  the  terminal. 

2.  To  administer  the  game  by  calling  the  other  modules  in 
the  appropriate  sequence,    and  to  gather  and  rearrange  data  for  the 
arguments.     This  is  the  "main  program"  function. 

3.  To  set  up  the  initial  board  and  initialize   game  statistics 
and  variables. 

4.  To  generate   random  numbers  for  use  as  the  dice  roll. 

5.  To  select  the  strategy  for  the  next  move. 

6.  To  provide  a  mechanism  by  which  other  modules  can 
determine,    for  any  roll  of  the  dice,    the  points  on  the  board  to  which, 
and  from  which,    legal  moves  may  be  made. 
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7.  To  generate  moves  for  the  selected  strategy  and  record 
them  in  a  coded  form. 

8.  To  decode  the  moves  and  place  them  in  a  conventional 
list. 

9.  To  evaluate  the  moves  in  the  list  and  assign  scores. 

10.  To  locate  the  move  with  the  highest  score  and  rearrange 
the  list  for  further  evaluation  if  necessary. 

11.  To  implement  the  selected  move  and  update  the  game 
board  and  the  cumulative  statistics. 

12.  To  print  the  resulting  board. 

13.  To  adjust  coefficients  after  a  move  has  been  graded  by 
the  terminal  user. 

14.  To  perform  a  variety  of  utility  functions  such  as  displaying 
or  searching  the  list  of  moves,    and  printing  or  storing  the  tactics  and 
coefficients. 

B.      BOARD  REPRESENTATION 

Representing  the  Backgammon  board  internally  is  a  relatively 
simple  matter.      Unlike  many  games  which  utilize  a  two-dimensional 
board,    Backgammon  pieces  move  in  one  dimension  only.      Hence,    the 
board  can  be  represented  as  a  linear  array  of  size  24,    one  element 
for  each  point  on  the  board.      Since  only  one  player  may  occupy  a 
given  point  the  number  of  pieces  on  any  point  can  be   represented  by 
an  integer,    positive  for  White  pieces,    negative  for  Black.     The  points 
are  numbered  from  1  to  24  beginning  in  White's  inner  table,    and 
continuing  through  his  outer  table  and  Black's  outer  and  inner  tables. 
While  this  method  of  numbering  is   reversed  in  the  usual  mathematical 
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sense,    it  conforms  to  the  customary  notation  of  Backgammon 
literature. 

In  portraying  the  Backgammon  board  at  the  terminal  or  on 
printed  output  the  following  conventions  were  adopted: 

1.  The  board  is   represented  with  the  two  halves  joined  in 
linear  fashion  with  White's  inner  table  and  point  24  to  the  left.      White 
moves  from  right  to  left,    and  Black  from  left  to  right. 

2.  White  pieces  are  represented  by  an  "O",    Black  pieces 
by  an  "X".      To  reduce  the  physical  size  of  the  board  a  maximum  of 
two  O's  or  X's  are  displayed  on  any  one  point.     Any  men  in  excess  of 
two  are  denoted  by  an  integer  placed  immediately  above  that  point. 

The  figure  below  is  the  Gammon  display  corresponding  to  the 

starting  board  setup  shown  in  Figure   1,    Section  III. 

******************** 

** 

**         INITIAL    BOARD    SETUP 

** 

**  3         1  3    3  13 

**0  XX  OX  00  X 

**    |0 X|     .X.  .     .     .0  |  X 0.     |0 X| 

**    2U  19    18  13    12  7    6  1 

** 

**    STRATEGIES:   W:  POSITION   B:  POSITION 

** 

******************** 

Figure  2.      Program  Representation  of  the  Backgammon  Board 
3.      Moves  are  represented  on  this  board  by  specifying 
the  numbers  of  the  points  from  and  to  which  the  men  move.     A 
"half  move"  is  a  move  of  a  single  man  the  number  of  points  shown 
on  one  die,    such  as   12-17  for  a  die  showing  5.     A  "single  move" 
involves  either  one  man  in  two  steps,    one  for  each  die,    or  two 
men,    each  moving  the  number  of  points  shown  on  a  single  die. 
This  is  the  normal  move.      For  example,    for  a  roll  of  5-2  the 
move  12-17,    17-19  denotes  the  move  of  one  man  from  the   12-point 
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to  the  17 -point,    and  thence  from  the  17-point  to  the  19 -point.       A 
"double  move"  involves  four  die  units   since  a  throw  of  doubles  is 
given  twice  the  amount  shown.      For  a  throw  of  4-4  for  example,    a 
double  move  might  be  denoted  as   12-16,    12-16,    12-16,    16-20,    which 
represents  the  move  of  three  men  from  the   12-point  to  the   16-point 
and  one  man  up  four  points  from  the  16-point. 

From  White's  standpoint,    a  move  which  brings  a  man  on  the 
board  from  the  bar  is  of  the  form  0  -   P;  and  a  bearing  off  move  as 
P-25,    where  P  is  the  number  of  some  point  on  the  board.      The  role 
of  the  0-point  and  the  25-point  as  extensions  of  the  board  are  reversed, 
of  course,    for  Black. 

C.      GAME  STATISTICS 

Several  numeric  quantities  which  describe  significant  features  of 
the  state  and  progress  of  the  game  are  maintained  by  the  program. 
Separate  sets  are  maintained  for  White  and  Black. 

These  statistics  are: 

1.  The  current  strategy  employed  by  each  player. 

2.  The  cumulative  dice  count.      This  is  a  measure  of  the 
"resources"  allocated  to  each  player. 

3.  The  advance  of  each  player.      If  we  think  of  the  initial 
board  configuration  as   representing  a  zero  position,    then  moving  a 
man  forward  6  points  is  an  advance  of  6.      The  advance,    then,    is  a 
measure  of  a  player's  progress.      By  subtracting  Black's  advance 
from  White's  advance  we  get  the  relative  point  advantage  for  White. 
This  latter  number  is  a  key  quantity  in  determining  which  strategy 
to  select.      Note  that  the  advance  and  cumulative  dice  count  usually 
become  unequal  as  the  game  progresses  because  of  men  being  hit 
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and  sent  back,    or  being  prevented  from  moving  by  a  block. 

4.  Bear-off  Distance.      This  is  a  measure  of  the  total  number 
of  man-points  a  player  must  advance  before  he  can  begin  the  end- 
game or  bearing  off  phase.      From  the  starting  board  positions,    the 
bear-off  distance  is  77.     Since  the  average  dice  roll  provides  an 
advance  of  approximately  8  1/3  points  (doublets  give  twice  as  many 
points  as  the  dice  count),    the  bearing  off  phase  can  be  reached  on 
average  of  9-10  moves,    provided  no  blots  are  hit. 

5.  Overlap.     This  is  a  measure  of  the  advance  required  to 
get  one's   rearmost  men  safely  past  the  opponent's  rearmost  men.      It 
is  computed  by  multiplying  the  distance  (in  points)  separating  the 
rearmost  men  by  the  total  number  of  such  men.      Overlap  is  another 
key  factor  in  strategy  selection. 

6.  The  number  of  home  points  held.      This  is  a    simple  tally 
of  the  number  of  White  home  points  held  by  White,    and  Black  home 
points  held  by  Black. 

7.  The  number  of  opponent's  home  points  held.     This  is  a 
count  of  White  home  points  held  by  Black,    and  vice  verse. 

8.  The  number  of  men  left  to  bear  off.     The  sum  of  a  player's 
pieces  left  on  the  board  and  those  on  the  bar.     The  first  player  to 
reduce  this  quantity  to  zero  wins  the  game. 

9.  The  location  of  rearmost  men.     The  point  on  which  the 
rearmost  men  are  resting. 

10.  The  location  of  the  next-to- rearmost  men. 

11.  The  number  of  men  on  the  bar.     This  number  of  men 
must  all  be  brought  into  play  before  any  other  move  can  be  made. 
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12.  The  head  of  the  block.      The  point  on  which  the  forward- 
most  men  of  the  block  are   resting. 

13.  The  tail  of  the  block.     The  point  on  which  the  rearward- 
most  men  of  the  block  are  resting,    or  the  rear  location  of  the  blocking 
region. 

14.  The  block  potential.      This  number  has  the  form  XYZZ, 
where  X  is  the  number  of  points  a  player  holds  in  his  blocking  area, 
Y  is  number  of  points  the  opponent  holds  in  the  same  area,    and  ZZ  is 
a  measure  of  the  likelihood  of  improving  the  block  by  filling  in  the 
remaining  gaps.     A  perfect  block  --  six  consectively  held  points   -- 
would  have  a  block  potential  of  6000,    that  is,    6  points  held,    none  held 
by  the  opponent,    and  no  opportunity  for  improvement.     The  blocking 
potential  is  used  in  deciding  whether  or  not  to  adopt  a  blocking 
strategy. 

D.      THE  TACTICS  OF  GAMMON 


Tactics  are  the  fundamental  logical  elements  of  Gammon.     Each 
tactic  corresponds  to  some  feature  or  minor  objective  of  the  game. 
Examples  of  tactics  are  to  advance  the  rearmost  men,    to  cover  blots, 
to  occupy  certain  key  points,    to  get  men  into  the  inner  table  as  soon 
as  possible,    to  construct  a  block,    and  to  hit  the  opponent's  blots. 

The  process  within  Gammon  which  selects  the  next  move  is   solely 
concerned  with  generating  legal  moves  which  tend  to  accomplish  the 
objectives  of  these  tactics,    and  with  evaluating  moves  by  measuring 
the  degree  to  which  they  achieve  the  tactical  objective.      Consider,    for 
example,    tactic  number  32  which  is  to  occupy  the  opponent's   7-point. 
The  move  generator  for  tactic  32  finds  all  legal  moves  using  the 
current  dice  roll  which  result  in  one  or  more  men  moving  to  the 
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opponent's  7-point.     The  move  evaluator  for  tactic  32  examines  every 
move  generated  and  awards  points  based  on  the  extent  to  which  the 
move  improves  the  occupation  of  the  7-point.      If  the  point  is  already- 
held  by  you,    no  points  are  awarded  because  the  move  does  not  add 
anything  to  the  existing  situation.     If,    say,    the  point  is  unoccupied, 
moving  two  men  there  is  awarded  more  points  than  moving  a  single 
man  to  the  point. 

Gammon  has  the  capability  to  accommodate  50  tactics,    of  which 
approximately  45  are  active.     Some  of  these  are  Boolean  combinations 
of  others,    for  example,    enter  and  hit,    or  enter  and  cover.     Some 
tactics  have  operational  similarities.      For  example,    tactics  30-39  are 
all  concerned  with  occupying  key  points. 

A  complete  list  of  all  tactics  with  brief  descriptions  of  their 
objectives  is  contained  in  Appendix  A. 

E.      THE  STRATEGIES  OF  GAMMON 

Recall  that  the  conventional  strategies  in  Backgammon  are  position, 
running,    blocking,    back,    and  bearing  off.      One  of  the  main  design 
objectives  of  Gammon  was  to  impart  the  main  characteristics  of  these 
strategies  to  sequences  of  moves,    rather  than  to  consider  each  move 
separately. 

The  mechanism  developed  to  implement  this  concept  was  to  define 
the  strategies  as  a  finite  sets  of  tactics.      Each  tactic  in  turn,    has  an 
objective  which  acts  as  a  goal  for  generating  and  evaluating  moves. 

The  operational  definition  of  the  strategies  was  arrived  at  by 
analysis  of  the  conventional  game  strategies  given  in  Backgammon 
literature.     The  first  step  was  to  identify  as  many  tactics  as  possible, 
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regardless  of  the  particular  style  of  play  with  which  they  were  associa.- 
ted.      The  second  step  was  to  group  the  tactics  in  such  a  way  as  to 
describe  in  operational  terms  the  various  strategies. 

Seven  such  strategies  were  ultimately  defined.     They  correspond 
closely  to  the  traditional  strategies.      For  the  running  and  bearing  off 
strategies,    however,    two  distinct  sets  of  tactics  were  defined,    one 
describing  an  offensive  style,    i.  e.  ,    the  absence  of  any  threat  of 
capture  from  the  opponent,    and  a  defensive  counterpart,    i.  e.  ,    the 
same  basic  style  of  play,    but  conducted  in  the  presence  of  enemy 
threat  of  capture.     The  seven  strategies  of  Gammon  are: 

1.  Position 

2.  Running-offensive 

3.  Running-defensive 

4.  Blocking 

5.  Back 

6.  Bearing  off-offensive 

7.  Bearing  off-defensive 

Each  "machine"  player  in  Gammon  is  provided  with  a  7  x  30  array 
containing  the  identification  numbers  of  the  tactics  comprising  his 
strategies. 

Within  a  set,    the  same  tactic  may  be  a  member  of  more  than  one 
strategy.      For  example,    tactic  32,    Occupy  Opponent's  7 -point  might 
be  a  member  of  the  Position  strategy,    the  Blocking  strategy,    and  the 
Defensive  Running  strategy.     However,    analysis  of  the  literature  in- 
dicates that  occupying  the  7-point  is  very  important  in  the  blocking 
game,    moderately  important  in  the  position  game,    and  of  little  im- 
portance in  the  running  game. 

To  enable  the  program  to  make  this  kind  of  distinction,    each 
"machine"  player  is  also  provided  with  a  7  x  30  array  of  coefficients. 
The  magnitude  of  each  coefficient  indicates  the  relative  importance 
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of  the  corresponding  tactic.      These  coefficients  are  used  as  multi- 
plication factors  in  the  evaluation  process.     The  evaluator  for  a 
tactic  awards  points  independently  of  the  strategy.      However,    this 
partial  score  is  multiplied  by  the  coefficient  from  the  appropriate 
strategy  and  thereby  imparts  the  relative  importance  of  that  tactic  to 
the  player's  current  strategy. 

In  defining  the  strategies,    each  tactic  was  placed  in  one  of  three 
priority  classes.     The  initial  coefficient  load  assigned  a  value  of  4  to 
those  in  the  highest  priority  level,    2  in  the  intermediate  level,    and  1 
in  the  lower  level.     As  learning  progressed  these  values  changed 
considerably.      Gammon  was  provided  with  the  capability  to  rearrange 
the  tactic  numbers  and  coefficients  within  its  strategies  so  as  to 
place  the  highest  valued  ones  first.     As  will  be  pointed  out  later,    this 
partitioning  of  the  strategy  sets  was  also  a  useful  operational  device. 

Appendix  B  contains  a  listing  of  a  representative  set  of  strategy 
definitions  in  terms  of  the  component  tactics. 

F.   MOVE  GENERATION  AND  EVALUATION 

The  process  of  generating  and  evaluating  moves  is  the  heart  of 
Gammon.     Two  of  the  program  modules  are  directly  involved  in  this 
process  and  three  others  indirectly. 

The  information  required  at  the  beginning  of  the  cycle  is  the 
current  game  board,    the  dice  roll,    the  identity  of  the  player  who  is 
to  move  (the  active  player)  and  his  strategy.     The  logic  of  the  cycle 
is  basically  as  follows: 

1.     Retrieve  the  first  tactic  identification  number  from 
priority  level  1  of  the  appropriate   strategy  set  of  the  active  player. 


26 


2.  Generate  moves  for  this  tactic. 

3.  Repeat  the  process  for  all  other  tactics  in  the  first 
priority  level. 

4.  If  no  moves  have  been  generated  for  first  level  tactics, 
repeat  the  process  for  level  two  tactics,    etc. 

5.  Evaluate  each  move  on  the  list  using  the  tactics  of  level 
one,    multiply  the  partial  score  of  each  tactic  by  the  corresponding 
coefficient  and  accumulate  the  total  score  for  the  move. 

6.  If  the  total  score  of  one  of  the  moves  is  greater  than  the 
score  of  the  other  moves  by  some  predetermined  margin  then  select 
that  move.     Otherwise  resolve  the  tie  by  evaluating  those  moves  with 
nearly  equal  scores  using  the  tactics  at  level  two,    and  so  on. 

Thus  the  more  heavily  weighted  tactics  within  a  strategy  definition 
will  tend  to  dominate  the  selection  process  at  both  the  generation  and 
evaluation  stages.     This  "pruning"  of  the  conceptual  game  tree  was 
designed  primarily  to  reduce  the  processing  time  in  order  to  improve 
the  response  time  in  the  interactive  version.      In  the  batch  mode,    where 
processing  time  is  less  critical,    this  device  is  overridden  by  con- 
tinuing to  generate  moves  until  some  predetermined  maximum  number 
of  moves  is  reached.     The  criteria  for  "tied"  scores  can  be  adjusted 
at  the  terminal,    providing  another  means  of  varying  the  number  of 
moves  considered. 

In  assigning  partial  scores,    the  gradations  of  "goodness"  were 
kept  within  the  range  of  0-1.      Interim  scores  were  assigned  on  a  64 
point  scale  (e.  g.  ,    16  points  for  a  fair  move,    32  for  good,    64  for 
perfect),    divided  by  64,    and  then  multiplied  by  the  coefficient. 

All  moves  are  generated  and  evaluated  as  if  White  were  to  play. 
On  Black's  move,    the  board  is  converted  prior  to  the  cycle  and 
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re -translated  on  return. 

G.      RISK  EVALUATION 

As  noted  earlier,    Gammon  does  not  normally  explore  the  game 
tree  beyond  the  first  level.      However,    in  the  event  that  a  proposed 
move  leaves  a  man  exposed,    the  program  assesses  the  consequences 
by  assigning  a  risk  value  to  that  move.     The  logic  in  this  assessment 
is  essentially  as  follows. 

1.  Locate  the  exposed  man  and  determine  if  it  has  captured 
an  opponent  as  a  result  of  this  move.      If  so,    award  positive  points 
depending  on  the  value  of  the  captured  man  (his  advance).      Moreover, 
if  it  is  probable  that  the  captured  man  will  be  prevented  from  coming 
back  on  the  board  because  of  positions  which  you  block,    then  award 
additional  points. 

2.  Scan  ahead  on  the  board  and  locate  enemy  pieces  which 
may  hit  your  blot  on  the  next  play.     Subtract  points  based  on  the 
advance  of  your  man,    the  number  of  threatening  men,    and  the  prob- 
ability that  these  men  will  be  able  to  hit.     These  calculations  are 
simplified  by  the  fact  that  probability  tables  exist  in  Backgammon 
literature  for  (1)  entering  the  board  as  a  function  of  the  number  of 
open  points  and  (2)  hitting  a  blot  as  a  function  of  its  distance  away  and 
the  number  of  intervening  closed  points. 

3.  Repeat  the  first  two  steps  for  each  exposed  man  on  the 
board,    and  accumulate  the  values. 

The  risk  value  assigned  to  a  move  may  be  either  positive  (e.  g.  , 
when  a  man  has  been  captured  and  little  threat  of  a  return  hit  exists) 
or  negative. 
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Mechanically,    risk  is  treated  as  a  tactic.      It  has  a  coefficient 
which  reflects  the  importance  of  risk  to  the  particular  strategy. 

H.      STRATEGY  SELECTION 

The  determination  of  the  strategy  to  be  used  is  determined  by 
analysis  of  two  sets  of  numbers:    the  game   statistics,    described 
above,    and  a  set  of  parameters  which  delimit  the  transition  points 
from  one  strategy  to  another,    in  terms  of  the  relative  point  advantage. 

Typical  advice  from  Backgammon  experts  is  to  use  the  back  game 
only  when  one  is  "far"  behind,    and  the  blocking  game  when  one  is 
"slightly"  behind.     The  program  uses  the  parameters  to  define  these 
points.      For  example,    the  transition  parameter  for  the  back  game 
is   -  50,    i.  e.  ,    the  program  will  not  select  the  back  strategy  unless 
the  player  is  at  least  50  points  behind.      Meeting  the  parameter  criteria 
alone  is  usually  not  sufficient  to  justify  a  transition. 

Another  key  criterion  is  the  other  player's  strategy.      With  rare 
exceptions,    a  back  game  and  a  blocking  game  are  countered  by  a 
running  game  unless  the  opportunity  for  blocking  is  high. 

Selection  of  bearing  off  strategies  is  relatively  straightforward, 
since  the  rules  of  the  game  define  exactly  when  bearing  off  is  per- 
mitted.    The  choice  of  defensive  or  offensive  styles  is  simply  a 
matter  of  whether  a  threat  exists. 

These  and  other  considerations  are  embodied  in  the  set  of 
decision  rules  which  the  program  uses  to  select  a  strategy.      If  the 
transition  tests  fail,    the  program  retains  the  previous  strategy,    in 
order  to  prevent  unnecessary  jumping  back  and  forth  between 
strategies. 
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Two  other  factors  need  mention  here.     First,    each  player  is  per- 
mitted to  "know"  the  other's  strategy.     This  is  largely  justified  on 
the  basis  that  in  actual  play,    the  strategy  of  the  other  person,    if  he 
has  one,    is  usually  apparent. 

The  second,    and  perhaps  more  valid  weakness  of  the  strategy 
selection  process  is  that  the  selection  is  made  before  the  moves  are 
generated,    hence  consideration  of  the  next  move  as  a  factor  in  the 
selection  is  disregarded.     The  human  player  normally  includes  in  his 
analysis  an  assessment  of  whether  a  suitable  move  exists  to  justify  a 
choice.     The  decision  to  adopt  a  blocking  game,    for  example,    is  not 
made  unless  a  reasonably  good  blocking  move  can  be  made  on  the  next 
play. 

I.        THE  PROGRAM  MODULES 

The  major  functions  performed  by  the  program  were  identified 
earlier.      In  this   section  these  functions  are  associated  with  the  specific 
modules  which  accomplish  them,    and  in  the  following  section  the 
general  interrelationships  among  the  modules  is  outlined. 

Detailed  descriptions  of  the  modules,    their  principal  subroutines, 
and  significant  programming  techniques  are  contained  in  Appendix  C. 

Briefly,    the  modules  and  their  major  functions  are  as  follows: 

1.  GAMMON  is  the  designated  main  program,    but  acts  only 
as  an  interface  between  the  terminal  user  and  the  rest  of  the  program, 
accepting  two-letter  command  codes  and  brandling  to  the  appropriate 
entry  point  in  other  modules. 

2.  SETUP  is  activated  only  in  the  beginning  of  a  game.      It 
retrieves  the  desired  board  configuration,    strategy  and  coefficient 
sets  from  disk  files,    and  initializes  the  game  statistics. 
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3.  ROLL  generates  the  random  integers  used  as  the  dice 
roll. 

4.  MASK  produces  a  bit  array  which  identifies  all  positions 
on  the  current  board  which  the  active  player  may  either  move  to  or 
move  from,    using  various  configurations  of  moves  with  the  current 
dice  roll. 

5.  MVGEN  contains  the  move  generators  for  each  of  the 
tactics.      It  refers  to  the  array  produced  by  MAj^K  to  ensure  that  any 
move  generated  is  legal.      To  avoid  duplication,    moves  are  uniquely 
encoded  using  bit  strings,    each  of  which  records  all  generated  moves 
of  a  certain  type  or  geometrical  profile. 

6.  MVLIST  decodes  the  bit  strings  encoded  by  MVGEN.     The 
moves  are  translated  into  the  customary  notation  and  placed  in  a 
conventional  list. 

7.  MVEVAL  contains  the  evaluators  for  each  tactic.      In 
performing  the  evaluations  of  each  move  on  the  list,    it  implements 
each  proposed  move  on  a  temporary  board,    analyzes  the  changes, 
and  measures  the  degree  to  which  the  objective  of  each  appropriate 
tactic  is  achieved  as  a  result  of  the  change.      Risk  analysis  is  also 
performed  by  this  module. 

8.  MVPICK  places  the  move  with  the  largest  score  at  the 
top  of  the  list  and  rearranges  the  remaining  list  such  that  all  moves 
whose  scores  are  within  a  specified  interval  of  the  largest  are  placed 
next  on  the  list.      Those  not  qualifying  are  discarded. 

9.  MVIMP  implements  the  move  at  the  top  of  the  list  after 
the  evaluation  cycle  is  completed.      It  updates  the  current  game  board, 
the  game  statistics,    and  certain  data  used  by  other  modules. 
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10.  PUT1  displays  the  updated  board,    the  move  and  its   score, 
the  number  of  men  on  the  bar,    and  the  current  strategies  of  each 
player.     The  Computer  Output  section  of  this   report  contains  a  com- 
plete game  using  the   standard  format.     An  abbreviated  format  is  used 
in  terminal  play  in  order  to  reduce  printing  time. 

11.  ADMIN  is  the  most  complex  module.     It  performs  the 
"main  program"  function,    i.  e.  ,    calls  the  other  modules  in  the  ap- 
propriate sequence,    and  arranges  data  for  their  use.      Its  subroutines 
determine  the  strategy  to  be  used,    check  the  legality  of  moves  entered 
at  the  terminal,    and  execute  most  of  the  commands  issued  by  the 
terminal  user.     ADMIN  detects  certain  game  situations  which  require 
a  departure  from  the  logic  of  the  main  cycle,    such  as  entering  a 
single  man  from  the  bar,    end-of-game,    and  no-moves. 

J.   GENERAL  PROGRAM  FLOW  AND  LOGIC 

Having  examined  the  concepts  and  components  of  Gammon,    the 
general  flow  of  the  game  can  now  be  summarized.      Figure  3  is  a 
Flow  chart  of  the  overall  logic  of  the  program.     The  chart  applies  to 
a  single  batch  game  between  two  virtual  machine  opponents. 

Two  branch  points  are  noted  on  the  chart  which  require  elabora- 
tion.     In  both  cases  a  deviation  from  the  normal  flow  of  the  program 
is  required  in  order  to  handle  a  unique  situation.      Each  case   requires 
a  single  move  to  be   constructed  from  two  separately  generated  half- 
moves.     The  first  special  branch  point  is  DO_ENTER.      This  part  of 
the  program  deals  with  the  situation  where  a  player  has  a  single  man 
on  the  bar  which  must  be  brought  into  play  immediately.      The  first 
half-move,    if  available,    brings  the  man  on  the  board.     An  interim 
updating  is  then  accomplished.      The  next  step  is  to  generate  the 

32 


c 


BEGIN 


D 


CALL 

GAMMON 


CALL 

ADMIN 


ESTABLISH  OPTIONS 


-  Mode? 

Print  to  file? 

Get  code  for  board 

Get  code  for 
strategy  and 
coefficient  sets 
-  Trace? 

Who  has  first  move? 

Get  seed  for  dice  roll 

Get  initial  black 
and  white  strategies 


CALL 
SETUP 


Read  in: 

Board. 

Strategy  & 

coefficient 

sets. 
Initialize 
Game  Statistic; 


CALL  PUT1 


Print  initial 
Board 


Figure  3a.   General  Program  Flow 


33 


© 


d> 


1 — 

CALL 
ROLL 


CALL 
MASK 


CALL 
GETSTRT 


Strategy 
..Selection 


No 


ENTER 


J 


Half -Move 
Operations 


DO SQUEEZE) 


Half -Move- 
Operations 


Figure  3b.   General  Program  Flow  (cont.) 


34 


Q 


MOVE  CYCLE 


3 


CALL 

MVGEN 


GENERATE 


I 


CALL 
MVLIST 


LIST 


No 


c^y* — 


CALL 

MVEVAL 


EVALUATE 


CALL 
MVPICK 
SELECT 


CALL 
OUTl 


'rint   Boaid 


\? 


Change 
Active 
Player 


STOP 


J 


Figure  3c.   General  Program  Flow  (cont.) 


35 


second  half  of  the  move  using  the  other  available  die. 

The  second  special  case  is  performed  in  the  DO   SQUEEZE 
branch.     This  situation  occurs  when  a  player  has  a  single  man  left 
to  bring  into  the  bearing-off  area,    and  it  is  possible  to  do  so  using 
only  one  die.      The  first  half-move  attempts  to  squeeze  this  last 
runner  into  the  bearing-off  area.      If  this  is  successful,    the  strategy 
of  the  player  is  changed  to  bearing-off,    and  the  board  is  partially 
updated.     The  second  half-move  is  a  normal  bearing-off  move  using 
the  other  die.     The     two  half-moves  are  then  paired  up  and  the  entire 
move  implemented  in  the  usual  manner. 

Gammon  departs  from  the  established  rules  of  Backgammon  in 
only  one  respect,    the  play  of  doublets.     According  to  the  rules,    all 
four  half-moves  are  accomplished  as  a  single  sequence.     However, 
mechanisms  to  analyze  and  record  all  possible  configurations  of 
4-unit  moves  become  extremely  complex.      Gammon  compromises 
by  implementing  a  doubles  move  in  two  single -move  steps.      On  the 
first  of  the  two,    the  risk  evaluator  is  disenabled.     The  effect  is  to 
give  the  system  a  chance  to  accept  a  higher  risk  move  on  the  first 
cycle,    knowing  that  it  will  have  an  opportunity  to  make  adjustments 
immediately  afterward. 

K.      LEARNING  MECHANISMS 

The  learning  technique  employed  in  Gammon  was  a  relatively 
simple  deductive  mechanism.     The  coefficients  used  in  the  evaluation 
polynomial  were  initially  loaded  by  the  programmer  and  remained 
unchanged  during  run  time,    except  upon  command  by  the  operator. 

The  following  devices  were  available  to  the  human  "tutor"  in 
order  to  induce  learning. 
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1.      Following  the  selection  of  a  move  by  the  program,    the 
tutor  may  assign  a  numerical  grade  to  the  move.     The  program  re- 
peats the  evaluation  process  and  stores  the  partial  scores  for  each 
tactic  involved.     A  partial  score  is  the  product  of  the  evaluation  score 
for  that  tactic  and  the  corresponding  coefficient.     Also  accumulated 
are  the  sums  of  all  positive  partial  scores  and  all  negative  partial 
scores.     The  second  evaluation  is   carried  through  only  as  many 
priority  levels  as  was  the  original  process. 

The  program  then  adjusts  the  coefficients  of  the  tactics  making  up 
the  current  strategy  using  the  following  rules: 

a.  An  incremental  change,    XDELTA,    is  computed  for  the 
coefficient  of  each  tactic  which  participated  in  the  evaluation  process. 

b.  XDELTA  is  proportional  to  the  magnitude  of  the  assigned 
numeric  grade. 

c.  XDELTA  is  proportional  to  the   ratio  of  the  partial  score 
for  that  tactic  to  the  partial  sum  having  like  sign.     Thus,    if  a  given 
tactic  contributes  twice  as  many  positive  points  to  the  final  move  score 
as  another  tactic,    the  magnitude  of  the  change  in  the  first  coefficient 
would  be  twice  as  large  as  the  second. 

d.  The  sign  of  XDELTA  is  positive  if  the  signs  of  the  grade 
and  the  partial  score  are  the  same,    negative  if  these  signs  are  dif- 
ferent.     For  example,    if  a  move  were  given  a  grade  of  +3,    the  coef- 
ficients of  all  tactics  which  helped  make  the  total  move  score  positive 
(i.e.  ,    their  partial  scores  were  positive)  would  be  made  more  positive. 
The  coefficients  of  those  tactics  which  contributed  negatively  to  this 
"good"  move  would  be  decreased. 
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e.      The  signs  of  coefficients  are  kept  positive.      The  continuous 
adverse  contribution  of  a  tactic  will  result  in  its  coefficient  becoming 
increasingly  small. 

2.     A  second  training  device  is  to  carry  out  the  same  kind  of 
process  described  above  using:  (a)  moves  generated  by  the  program, 
but  not  selected  because  of  an  insufficient  score,    or  (b)  moves  not 
generated  by  the  program  but  supplied  by  the  tutor.     After  the  program 
has  completed  its  move,    all  or  part  of  the  list  of  moves  which  it  con- 
sidered may  be  displayed,    along  with  the  move  scores.     The  tutor  may- 
select  one  or  more  of  these  moves  to  be  re -evaluated  and  graded  as 
described  above.      Moreover,    if  the  program  failed  to  generate  moves 
which  the  tutor  thinks  are  particularly  good  or  bad,    examples  of  these 
may  be  entered,    evaluated,    and  graded. 

Following  a  training  session  the  tutor  may  invoke  routines  which 
will  display  the  current  or  old  sets  of  tactics  or  coefficients,    or  store 
the  current  sets  on  disk  files  for  future  use.      It  is  also  possible  to 
perform  a  sort  operation  on  the  current  coefficient  sets,    placing  the 
largest  coefficients  in  the  first  priority  level.      In  this  process,    the 
corresponding  tactic  numbers  are   similarly  rearranged. 

L.      MODES  OF  PLAY  AND  PROGRAM  OPTIONS 

Gammon  is  a  versatile  program  with  respect  to  the  number  and 
types  of  different  operations  which  may  be  performed.      Some  of  these 
have  been  mentioned  in  the  course  of  the  foregoing  discussion.      How- 
ever,   a  consolidated  summary  of  these  options  will  better  reveal  this 
scope. 

1.     The  program  may  operate  either  interactively  or  in  a  batch 
mode. 
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2.  In  the  batch  environment,    three  different  types  of  runs  may 
be  specified.      The  first  is  a  standard  single  game,    the   second  is  a 
series  of  two  games  with  both  players  being  provided  identical  dice 
rolls,    and  the  third  is  a  series  of  five  games,    each  of  which  is  con- 
ducted with  identical  rolls.      The  technique  of  using  identical  rolls 
for  both  players  during  a  play-response  cycle  is  to  reduce  inequities 
introduced  by  the   random  dice  rolls. 

3.  Program  output  may  be  directed  to  a  disk  file  for  printing 

at  a  later  time,    or  may  default  to  the  terminal  or  the  system  printer. 

4.  In  the  terminal  version,    the  user  may  request  the  program  to 
evaluate  his  moves,    providing  another  means  of  judging  the  system's 
performance. 

5.  A  trace  option  may  be  specified.     With  the  trace,    the  progress 
of  the  program  throughout  all  the  modules  is  provided  in  detail,    in- 
cluding abbreviated  boards  and  partial  scores  for  every  move 
evaluated. 

6.  Any  of  several  starting  board  configurations  may  be  specified. 

7.  The  user  may  alter,    during  play  at  the  terminal,    the  trace 
option,    the  strategy  of  either  player,    or  the  value  of  the  criteria  for 
"tied"  moves.     A  game  may  also  be  restarted,    without  terminating 
execution. 

8.  The  user  may  have  displayed  all  or  a  specified  number  of 
the  moves  in  the  current  move  list.      He  may  also  enter  a  move,    have 
the  program  determine  whether  it  is  on  its  c\irrent  list,    and  have  the 
score  displayed. 

9.  The  user  may  have  displayed  the  current  or  original  set  of 
tactics  and  coefficients.     This  data  may  also  be  directed  to  a  disk  file. 
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10.  The  user  may  grade  the  move  selected  by  the  program,    any 
move  on  the  current  list,    or  any  move  the  user  chooses  to  supply. 

11.  The  current  set  of  coefficients  may  be  exchanged  between 
the  two  players  on  command. 

12.  The  current  board  configuration,    or  sets  of  tactics  or  coef- 
ficients may  be  stored  on  disk  on  command. 

M.     ENVIRONMENT 

The  program  was  initially  developed  using  the  Cambridge  Monitor 
System  (CMS)  on  the  IBM  360/67  at  the  Naval  Postgraduate  School 
Computer  Facility.      In  the  midst  of  the  debugging  process   CMS  was 
replaced  by  IBM's  Time  Sharing  System  (TSS)  and  the  program  was 
converted.      Considerable  difficulty  and  loss  of  time  accompanied  this 
conversion. 

Gammon  consists  of  approximately  2900  PL/l  statements  and  is 
compiled  by  the  TSS  version  5  PL/l  compiler  into  a  total  of  about 
100  K  bytes  of  program  and  storage.      In  its  final  form  the  program 
comprises   11  modules   ranging  in  size  from  25-970  PL/l  statements. 

In  the  interactive  mode,    the  time   required  by  the  program  to 
complete  one  play  varied  from  5  seconds  to  2  minutes  depending  on 
the  number  of  tasks  active  in  the  TSS  system  and  the  number  of 
possible  moves  needing  evaluation.     The  average  response  time  at 
the  terminal  for  the  program  to  select  its  next  move  was  approximately 
30  seconds.      In  the  batch  mode,    the  average  CPU  time  required  to 
play  one  complete  game  was  approximately  one  minute. 
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V.       RESULTS  AND   CONCLUSIONS 

A.  PLAY  OF  STRATEGIES 

In  general,    Gammon  meets  its  design  objective  with  respect  to 
its  play  of  the  individual  strategies.      Moreover,    the  game  strategies 
as  played  by  Gammon  bore  a  reasonable   resemblance  to  the  traditional 
Backgammon  game  styles  they  were  intended  to  emulate.      Least 
acceptable  was  the  play  of  the  blocking  and  back  strategies.      To  some 
extent  this  was  anticipated  because  the  successful  construction  and 
advance  of  a  block  requires  considerable  skill,    even  for  human 
players. 

The  play  of  most  strategies  was  uneven  or  spotty.  The  program 
would  frequently  select  a  move  consistent  with  the  overall  character- 
istics of  the  strategy,    but  quite  unsuited  for  the  particular  situation. 

At  times,    the  move  selected  seemed  overly  conservative  with 
respect  to  the  general  intent  of  the  current  strategy.      On  other  oc- 
casions the  move  was  overly  aggressive.      When  faced  with  a  block, 
for  example,    Gammon  fails  to  capitalize  on  opportunities  to  move 
through  or  over  the  block. 

The  risk  evaluator  was  adequate  provided  the  major  consequences 
of  a  move  were  restricted  to  the  move  and  the  immediate  reply. 
Moves  selected  because  of  favorable  immediate  consequences  (e.  g.  , 
a  large  positive  point  award  restxlting  from  a  capture)  often  had  quite 
unfavorable  consequences  two  moves  later. 

B.  STRATEGY  SELECTION 

The  mechanism  for  strategy  selection  performed  at  an  acceptable 
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level.      However,    since  this  mechanism  only  required  the  application 
of  pre-defined  decision  rules  it  cannot  claim  any  special  distinction. 
Because  the  logic  of  the  process  favored  retention  of  the  current 
strategy  (unless  the  tests  for  transition  were  met)  the  program  oc- 
casionally persisted  with  a  strategy  beyond  the  point  suggested  by 
common  sense.     A  case  in  point  is  blocking.     The  program  usually 
continued  with  the  blocking  strategy  even  though  the  conditions  for 
maintaining  an  effective  block  no  longer  existed.      This  defect  could 
be  corrected  by  refining  the  decision  rules. 

C.      LEARNING 

A  thorough  evaluation  of  the  learning  mechanisms  was  not  possible 
because  of  time  constraints. 

Based  on  the  training  that  could  be  accomplished,    the  learning 
mechanism  did  improve  the  program's  performance.     In  particular, 
the  consistency  of  play  was  improved,    probably  because  a  better 
balance  was  achieved  among  the  coefficients.      Little  improvement 
was  noted  with  regard  to  the  program's  ability  to  exploit  unusually 
good  opportunities,    or  to  protect  itself  properly  when  presented  with 
an  unusually  high  threat  situation. 

The  learning  process,    because  it  requires  human  participation, 
is  quite  slow.      The  time  to  complete  a  reasonable  session  exceeded 
one  hour.      Moreover,    the  frequent  occurrence  of  system  failures 
lowered  the  probability  of  successfully  completing  any  extended 
training  session. 

Repeated  gradings  after  one  play  would  sometimes  disproportion- 
ately alter  a  small  number  of  coefficients.     As  a  result,    these  in- 
flated values  would  unfavorably  influence  the  evaluation  at  a  later 

42 


stage  of  play.     Thus,    the  training  session  needed  to  be  balanced 
throughout  the  course  of  a  game.     As  noted  above,    it  was  difficult 
to  accomplish  such  prolonged  sessions. 

D.  MAJOR  AREAS  OF  DIFFICULTY 

In  the  development  stages,    the  most  difficult  design  problems 
centered  around  the  techniques  for  determining  the  legality  of  moves, 
the  encoding  and  decoding  procedures,    the  provisions  for  handling 
entering  and  bearing  off  moves,    and  the  compatibility  and  coordina- 
tion among  the  modules. 

Whenever  possible,    modules  were  fully  tested  independently  of 
the  others.      However,    many  of  the  major  program  functions  could 
not  be  adequately  checked  out  until  all  of  the  modules  were  brought 
together.      The  main  difficulties  that  arose  at  this  time  centered 
around  the  various  special  situations   requiring  deviations  from  the 
logic  of  the  main  cycle.      Half-move  operations,    occurrences  of  no 
moves,    doublets,    and  simultaneous  provisions  for  the  various  modes 
of  play  and  options  were  major  complications. 

E.  MAJOR  STRENGTHS  AND  WEAKNESSES 

The  major  strengths  of  the  program  may  be  summarized  as 
follows: 

1.  In  general,    the  program  met  its  design  objectives  with 
respect  to  the  play  of  the  individual  strategies. 

2.  The  programs  play  an  interesting,    but  not  particularly 
skillful  game  of  Backgammon. 

3.  The  response  time  is  small  enough  to  be  able  to  complete  a 
game  in  one  setting.     When  the  number  of  users  in  the  system  is 
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low,    the  response  time  approaches  that  of  human  play. 

4.     The  program  is  quite  versatile,    permitting  the  terminal  user 
to  select  from  a  wide  range  of  options,    and  alter  conditions  during 
execution. 

The  major  weaknesses  are: 

1.  In  retrospect,    some  parts  of  the  program  are  unnecessarily 
complex.     Some  techniques  were  developed  to  minimize  problems 
which  turned  out  to  be  of  less  importance  than  originally  thought. 

2.  The  program  does  not  react  properly  to  unusual  temporary 
game  situations  requiring  departures  from  standard  styles  of  play. 

3.  The  play  of  the  strategies  tended  to  be  uneven  and  spotty. 

4.  The  lack  of  a  dynamic  learning  mechanism  which  could 
operate  in  batch  mode   seriously  impedes  the  rate  of  learning.      This 
deficiency  stems  from  the  fact  the  program  has  no  standard  against 
which  to  judge  the  adequacies  of  its  strategies,    except  the  human 
tutor. 

F.      SUGGESTED  IMPROVEMENTS 

To  alleviate   some  of  the  deficiencies  noted  above  the  following 
are  considered  to  have  the  potential  to  produce  detectable  improve- 
ments with  a  reasonable  investment  of  effort. 

1.     The  logic  of  the  move  generators  could  be  refined.     At  present, 
a  move  generator  essentially  generates  all  possible  moves  which 
might  satisfy  the  objective  of  that  tactic.      When  many  tactics  are 
involved,    the  final  list  actually  becomes  non-selective.     Another  way 
of  looking  at  it  is  that  since  there  are  so  many  tactics,    practically 
every  legal  move  is  bound  to  satisfy  one  of  them.      Nevertheless, 
most  of  the  generators   could  be  made  more   specific,    both  with  respect 
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to  (a)  producing  moves  with  higher  positive  potential,    and  (b)  screening 
out  moves  with  higher  negative  potential,    or  those  more  clearly  un- 
suited  for  the  particular  situation. 

2.  The  evaluators  could  undergo  a  similar  refinement,  if  only 
to  eliminate  inconsistencies  introduced  because  of  the  author's  lack 
of  Backgammon  expertise. 

3.  The  program  could  be  provided  with  the  capability  to  alter 
dynamically  the  composition  of  its   strategy  sets.      Deletions  could  be 
accomplished  by  the  program,    based  on  coefficients  which  become 
increasingly  small.      New  tactics  could  be  selected  at  random  from  a 
list  provided  by  the  programmer,    or  by  a  mechanism  such  as  that 
described  below. 

4.  The  program  needs  a  capability  for  accommodating  short  range 
objectives.     The  current  strategies  are  general  in  nature  and  are  not 
well  suited  for  exploitation  of  more  pressing  short  range  goals.      Many 
of  these  situations  could  be  described  as   generalized  board  configura- 
tions.    They  might  have  the  form  of  templates  which  could  be  matched 
against  the  present  or  proposed  board  in  order  to  determine  whether 
or  not  the  situation  exists.      If  a  match  were  made,    subsequent  genera- 
tion and  evaluation  procedures  would  attempt  to  satisfy  the  objective. 
However,    providing  the  program  with  the  capability  to  recognize  and 
describe  these  short  range  objectives  would  not  be  a  simple  task. 

G.      CONCLUSIONS 

The  main  conclusion  of  the  study  is  that  the  validity  of  the  strategy 
concept  developed  with  Gammon  was  generally  verified  by  the  perfor- 
mance of  the  program.     The  play  of  Gammon  using  its  strategies  took 
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on  the  overall  characteristics  of  the  corresponding  Backgammon 
styles  of  play.      However,    the  concept  needs  to  be  modified  in  order 
to  better  recognize  and  accomplish  short  range  objectives,    particular 
ly  high- opportunity  or  high-threat  situations. 
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APPENDIX      A 
THE  TACTICS  OF  GAMMON 
TACTIC  NO.  NAME /DESCRIPTION 

1  BRING  UP  REARMOST  MEN 

2  CLOSE  YOUR  INNER  TABLE 

3  CLOSE  OPPONENT'S  INNER  TABLE 

4  DO  NOT  EXPOSE  BLOTS 

5  HOLD  AS  MANY  POINTS  AS  POSSIBLE 

6  BUILD  A  BLOCK 

7  DEPLOY  CATCHERS  (BLOTS  THAT  ONE  WANTS 
HIT  IN  ORDER  TO  BRING  ON  IN  THE  BACK 
BLOCK  AREA) 

8  EXPOSE  BLOTS  IN  YOUR  INNER  TABLE 

9  FREEZE  RUNNERS 

10  MOVE  MEN  TO  YOUR  INNER  TABLE 

11  BRING  MEN  ON  8- POINT  HOME  IN 
PREFERENCE  TO  MEN  ON  7- POINT 

12  ADVANCE  THE  BLOCK 

13  MAXIMIZE  SAFE  MOVES 

14  LEAVE  A  LONG  RUNNER  BACK 

15  UNUSED 

16  MOVE  MEN  UP  FROM  THE  COMFORT 
STATION  (OPPONENT'S  12- POINT) 

17  BEAR  OFF  AS  MANY  MEN  AS  POSSIBLE 

18  MAXIMIZE  PROBABILITY  OF  BEARING  OFF 
TWO  MEN  ON  THE  NEXT  PLAY 

19  WHEN  BEARING  OFF  DEFENSIVELY,    MAKE 
HIGH  TWO  POINTS  BOTH  EVEN  OR  ODD 
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20  WHEN  BEARING  OFF,    MOVE.  TO  LOWER 
POINTS 

21  COVER  BLOTS 

22  DISTRIBUTE  MEN  IN  OUTER  TABLES 

23  BRING  MEN  INTO  SAFE  AREA  BEHIND 
OPPONENTS  REARMOST  MEN 

24-29  UNUSED 

30  OCCUPY  OPPONENT'S  5  POINT 

31  OCCUPY  OPPONENT'S  4  POINT 

32  OCCUPY  OPPONENT'S  7  POINT 
33-39  OCCUPY  YOUR  3-9  POINTS 

40  HIT  ALL  BLOTS 

41  HIT  BLOTS  IN  OUTER  TABLES 

42  HIT  BLOTS  IN  OPPONENT'S  INNER  TABLE 

43  HIT  BLOTS  IN  YOUR  INNER  TABLE 

44  UNUSED 

45  ENTER  ON  LOW  POINTS 

46  ENTER  AND  HIT 

47  ENTER  AND  DO  NOT  HIT 

48  ENTER  AND  COVER 

49  ENTER  AND  EXPOSE 

50  RISK  VALUE 
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APPENDIX  C 

DESCRIPTIONS  OF  THE  PROGRAM  MODULES 

1.      Gammon 

This  module  is  the  designated  main  program.      However,    in 

the  batch  version,    upon  receiving  control  it  immediately  passes  it  to 

ADMIN,    which  actually  performs  the  main  program  function.      In  the 

interactive  version  control  is  passed  back  to  GAMMON  after  each 

move  or  after  certain  types  of  errors.     The  principal  function  of 

GAMMON  is  to  accept  commands  from  the  operator  and  branch  to  the 

appropriate  point.     Several  two-character  command  codes  may  be 

issued  at  the  terminal.     The  purpose  of  the  commands  are   summarized 

below. 

GO     --     continue  the  game. 

XX    --     stop  the  game 

RE     --     restart  the  game  from  the  beginning. 

GR    --     grade  a  move. 

TR     --     change  the  trace  option. 

CS     --     change  a  player's  strategy. 

CD     --     change  the  quantity  "Delta"  which  defines  the 

range  within  which  evaluated  move   scores 

are  considered  equivalent. 
EV     --     enter  a  move  of  the  operator's  choice,    have 

it  evaluated  and  graded. 
GE     --     generate  a  move  for  some  other  strategy. 
DI     —     display  the  present  or  old  set  of  tactics  or 

coefficients  . 
SO     --     sort  the  present  sets  of  tactics  into  descending 

order  according  to  the  corresponding 

coefficients. 
LO    --    locate  the  given  move  in  the  list  of  moves  and 

display  its  score. 
LI      --     display  all  or  portions  of  the  list  of  generated 

moves. 
SW     --     exchange  the  strategy  and  coefficient  sets 

between  the  two  players. 
ST     --      store  the  present  strategy  and  coefficient 

sets  in  disk  files. 
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2.  SETUP 

This  module  is  called  only  at  the  beginning  of  a  game.      It  receives 
as  arguments  the  file  codes  of  the  initial  board  configuration  and  the 
strategy  and  coefficient  sets  of  the  players.      It  reads  in  this  data  and 
initializes  the  game  statistics.      It  also  reads  in  the  tables  containing 
the  probabilities  of  hit  and  entry,    as  well  as  a  table  containing  recom- 
mended opening  moves. 

3.  ROLL 

ROLL  returns  a  pair  of  integers  on  the  interval  (1,  6).     After 
generating  these  numbers,    which  serve  as  the  dice  roll,    it  passes 
them  back  such  that  the  first  die  is  greei-ter  than  or  equal  to  the  second. 
ROLL  is  initially  called  with  a  positive  odd  integer  SEED.      Thereafter, 
it  is  called  with  an  argument  of  0.     The  series  of  pseudo- random 
numbers  may  be   reproduced  by  providing  the  same  seed. 

4.  MASK 

The  function  of  this  module  is  to  provide  a  reference  by  which 
other  modules  can  determine  whether  or  not  a  legal  move  can  be  made 
either  to  or  from  a  given  point,    MASK  requires  as  arguments  the 
current  game  board  and  dice   roll  (Dl,    D2).      In  addition  to  these  argu- 
ments,   MASK  is  provided  two  bit  strings  of  length  24.     Each  bit 

position  corresponds  to  a  point  on  the  board.      One  string,    TO STR, 

has  a  1  in  each  position  corresponding  to  a  point  on  the  board  which  is 
not  held  by  an  opponent.     Thus  it  records  every  position  to_ which  the 
active  player  may  legally  move,    regardless  of  the  dice   roll.      The 

second  string,    FR STR,    contains  a  1  in  those  positions  corresponding 

to  points  on  the  board  where  the  active  player  has  men,    i.  e.  ,    positions 
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from  which  the  active  player  may  move,    regardless  of  the  dice  roll. 
MASK  then  proceeds  to  construct  a  bit  array  indicating  the  legal  to 
and  from  positions  for  the  current  dice  roll.     The  criteria  for  moving 
a  man  up  Dl  points  from  point  P  is  that  bit  P  of  FR      STR  =1  and  that 
bit  (P  +Dl)of  TO STR  =1.     This  is  done  for  all  four  possible  con- 
figurations of  moves  involving  a  single  man;       (1)  moving  Dl  points; 
(2)  moving  D2  points;  (3)  moving  Dl  points  and  the.nce  moving  D2 
points  (a  D1-D2  "bounce");  and  (4)  a  D2-D1  bounce.      The  TO  and 
FROM  arrays  have  dimensions  4  x  24  where  the  columns  correspond 
to  the  points  on  the  board  and  the  rows  indicate  the  type  of  move. 

The  construction  of  the  arrays  is  accomplished  by  performing 
sequences  of  shift  operations  (in  units  of  Dl  and  D2)  and  Boolean  AND 
operations. 

Suppose  that  a  generator  for  a  tactic  needs  to  know  whether  a 
man  can  be  moved  to  a  certain  point  on  the  board.     By  examining  the 
appropriate  column  of  the  TO  matrix,    it  can  determine  not  only 
whether  any  legal  moves  exist,    but  all  possible  forms  of  such  moves. 

5.       MVGEN 

This  module  contains  the  generators  for  the  tactics.  The  general 
logic  of  the  move  generation  process  was  discussed  above.  Here,  the 
method  by  which  moves  are  recorded  will  be  described. 

One  approach  to  recording  moves  would  be  to  generate  all  moves, 
record  them  in  the  X-Y,    W-Z  notation  and  then  analyze  the  list  to 
remove  duplicates.     This  method,    however,    would  envolve  consider- 
able processing  time  just  for  searching.     The  same  can  be  said  for 
the  method  of  searching  for  duplicates  after  each  single  move  was 
generated.     To  minimize  this  problem,    Gammon  records  its  generated 
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moves  in  coded  bit  strings   such  that  duplicate  moves  simply  set  the 
same  bits  equal  to  1.     After  the  generation  process  is  completed,    the 
bit  strings  are  decoded  into  the  conventional  X-Y,    W-Z  notation. 

The  coding  process  requires  a  total  of  17  bit  strings,    seven  of 
length  24  to  record  all   possible  configurations  of  normal  single 
moves,    eight  of  length  6  to  record  all  possible  configuration  of  bearing 
off  moves,    and  two  of  length  2  to  record  entering  moves. 

"Normal"  moves  have  seven  possible  configurations.      Their 
descriptions  and  the  names  of  the  strings  used  to  record  them  are: 

1.  SHI     -     move  a  single  man  from  point  P  to  point 
P  +  Dl  (single  hop  on  Dl). 

2.  SH2     -    a  single  hop  on  D2. 

3.  DH    -     moving  two  men  on  a  throw  of  doubles  from 
point  P  to  point  P  +  Dl. 

4.  B12     -    a  D1-D2  bounce. 

5.  B21     -    a  D2-D1  bounce. 

6.  CNV     -    a  converging  move,    i.e.  ,    one  in  which  men 
from  different  points  move  to  the  same  point. 

7.  FRK    -    a  forking  move,    i.  e.  ,    one  in  which  two  men 
from  the   same  position  move  to  two  different  points. 

A  last,    and  usually  quite  large,    class  of  moves  are  those  in- 
volving all  combinations  of  single  hops,    i.e.  ,    each  single  hop  recorded 
in  SHl  paired  with  each  single  hop  recorded  in  SH2.     These  combina- 
tions are  implicit  in  the  SHl  and  SH2  strings  and  are  combined  when 
the  strings  are  decoded. 

MVGEN  uses  three  subroutines  to  set  the  proper  bits  in  these 
strings. 

Each  has  two  arguments   --  a  point  on  the  board,    and  the  number 
of  die  units,    1  or  2,    available  as   resources  to  accomplish  the  move. 
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The  subroutines  are  (1)  MVTO,    which  encodes  all  moves   resulting  in 
a  man  or  men  being  placed  on  the  specified  point;  (2)  MVFM,    which 
encodes  all  moves  resulting  in  a  man  or  men  moving  from  the  specified 
point,    and  (3)  MVHIT,    which  encodes  all  moves   resulting  in  hitting  an 
exposed  enemy  piece  located  at  the  specified  point. 

Usually,    the  generator  for  a  tactic  performs  a  preliminary 
analysis  to  determine  the  points  on  the  board  which  should  be  involved 
in  the  move,    and  then  calls  the  appropriate   subroutines. 

6.       MVLIST 

The  function  of  this  module  is  to  decode  the  bit  strings,    translating 
the  moves  into  conventional  notation,    and  placing  the  moves  in  a  list. 
MVLIST  requires  as  arguments  the  encoded  bit  strings,    the  dice  roll, 
and  the  availability  number  (1  or  2)  which  indicates  whether  to  decode 
only  half-moves  or  regular  single  moves.      MVLIST  proceeds  through 
each  bit  string,    noting  the  location  of  l's  and  performing  the  translation. 

Suppose,    for  example,    that  bit  20  of  FRK  (fork  move)  were  equal 
to  1.      Then,    assuming  a  dice  roll  of  5-2,    the  move  20-15,    20-18 
would  be  placed  in  the  list.      Note  that  all  moves  are  treated  as  if 
White  were  to  move,    hence  the  movement  from  higher  to  smaller 
point  numbers. 

The  move  list  is  a  50  x  4  array  with  each  row  corresponding  to  a 
different  move,    and  the  four  columns  indicating  the  points  of  the 
board. 

In  decoding  the  single  hop  strings,    MVLIST  forms  all  possible 
pair-wise  combinations  after  first  eliminating  those  which  form  a 
move  already  encoded  as  another  type. 
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7.  MVEVAL 

This  module  evaluates  each  of  the  moves  in  the  current  move  list 
and  assigns  points  (plus  or  negative)  based  on  the  degree  to  which  the 
move  succeeds  (or  fails)  to  accomplish  the  objectives  of  the  tactics 
which  define  the  active  player's   current  strategy.     After  evaluating 
each  tactic  it  multiplies  the  partial  score  by  the  corresponding  coef- 
ficient and  accumulates  the  score  until  the  entire  process  for  that 
move  is  completed.      It  then  proceeds  to  the  next  move. 

In  making  the  evaluation,    MVEVAL  constructs  a  temporary  game 
board  which  incorporates  the  results  of  the  move  under  evaluation. 
In  many  of  its  assessments  it  compares  the  old  and  new  boards  to 
determine  change  as  a  result  of  the  move.      MVEVAL  performs  its 
evaluations  one  priority  level  at  a  time.      If  further  evaluations  are 
required  it  repeats  the  process  at  the  next  level  for  those  moves  still 
in  contention. 

Recall  that  in  the  terminal  version  the  human  "tutor"  can  assign 
a  grade  to  the   selected  move.      In  order  to  adjust  its  coefficients  the 
program  needs  to  know  the  partial  scores  for  each  tactic  evaluated. 
However,    it  was  considered  wasteful  of  storage  to  retain  all  of  these 
scores  for  all  moves.      Hence,    when  a  move  is  given  a  grade,    MVEVAL 
repeats  its  evaluation  process,    at  which  time  it  saves  all  of  its  partial 
scores  for  the  move,    as  well  as  accumulating  the  sums  of  all  positive 
and  negative  partial  scores.     The  use  of  these   special  sums  will  be 
discussed  later. 

8.  MVPICK 

Following  the  evaluation  of  the  list  of  moves,    MVPICK  locates 
the  move  with  the  maximum  score  and  places  it  at  the  top  of  the  list. 
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Immediately  below  this  move  are  placed  all  moves  whose  scores  are 
within  distance  DELTA  from  the  highest-scored  move.      The  remainder 
of  the  list  is  discarded.     By  making  DELTA  large  we  carry  over  more 
moves  from  one  priority-level  evaluation  to  the  next,    thus  reducing 
the  possibility  that  an  excellent  move  will  be  eliminated  from  further 
consideration  only  because  it  scored  poorly  at  one  priority  level. 
On  the  other  hand,    by  making  DELTA  small,    we  quickly  reduce  the 
size  of  the  list,    thereby  conserving  processing  time,    and  in  the  case 
of  the  interactive  version,    improving  the  response  time. 

If,    at  the  end  of  three  evaluation  cycles  (one  for  each  priority 
level)  there  is  more  than  one  move  on  the  list,    the  first  move  is 
selected  for  implementation. 

9.       MVIMP 

Implementing  the  selected  move  is  the  function  of  this  module.      If 
the  active  player  is  Black  it  translates  the  move  from  the  White -notation 
in  which  it  was  provided  into  the  proper  terms  for  Black.      It  then  up- 
dates the  game  board  by  adding  and  subtracting  men  from  the  appropri- 
ate points.      It  also  performs   checks  to  ensure  that  the  move  is  legal. 

It  then  proceeds  to  update  the  game  statistics,    revising  the  cumula- 
tive dice  count  and  advance,    relocating  the  rearmost  men,    etc. 

Finally,    it  updates  the  bit  strings  used  by  MASK. 

In  the  process  of  initializing  the  game  before  play  begins,    MVIMP 
may  be  involked  by  SETUP  in  the  event  that  the  initial  board  is  other 
than  the  standard  starting  configuration,    for  example,    a  training  board 
for  bearing-off  situations.      MVIMP  then  initializes  the  game  statistics 
by  analyzing  the  board,    reading  data,    or  prompting  the  user  to  supply 
needed  information. 
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10.  PUT1 

This  modules  performs  the  function  of  writing  the  resulting  board 
following  implementation  of  the  move. 

In  the  terminal  version  the  board  format  is  abbreviated  in  order 
to  reduce  the  printing  time.      This  was  especially  critical  using  TSS 
because  the  PL/l  output  introduces  an  unacceptably  long  delay  at  the 
end  of  each  printed  line. 

In  the  batch  mode,    the  boards  may  either  be  directed  to  SYSPRINT, 
the  normal  print  channel,    or  to  a  disk  file  data  set  in  the  user's 
library. 

Under  TSS,    a  game  can  be  initiated  at  the  terminal  as  if  it  were 
a  batch  game  and  run  to  completion  with  the  output  directed  to  the 
private  file.     This  file  can  then  be  printed  off-line,    reducing  the  turn- 
around time  to  a  few  minutes. 

A  sample  of  a  complete  batch  mode  game  is  included  in  the 
Computer  Output  section  of  this   report. 

11.  ADMIN 

Left  for  last  is  the  discussion  of  ADMIN,  the  module  which  is  the 
largest  and  most  complex.  It  embodies  the  main  logic  of  the  flow  and 
control  of  the  game  and,  except  in  name,  is  the  main  program.  It 
makes  the  tests  necessary  to  determine  the  state  and  progress  of  the 
game,  gathers  data  together  for  use  by  the  other  modules,  and  issues 
calls  to  the  other  modules  in  the  appropriate  sequence.  It  contains 
several  of  the  subroutines  needed  to  perform  the  commands  issued  by 
the  terminal  user. 

The  principle  subroutines  used  by  ADMIN  are: 
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a.  GETSTRT. 

This  routine  performs  the  important  function  of  strategy 
selection.      The  major  considerations  in  this  process  were  discussed 
in  Section  IV.    H. 

b.  CHECK 

The  purpose  of  CHECK  is  to  determine  whether  a  move 
entered  at  the  terminal  is  legal.     If  not,    it  prompts  the  user  to  re- 
enter the  move,    after  displaying  an  appropriate  diagnostic. 

c.  STORE  performs  the  function  of  writing  the  current  board, 
strategy  sets  or  coefficient  sets  on  disk  files. 

d.  SWAP  exchanges  the  current  strategy  sets  of  White  and 
Black. 

e.  DISPLAY  prints  the  current  strategy  and  coefficient  sets  of 
White  or  Black,    along  with  the  initial  sets  if  desired.     After  a  learning 
session  in  which  the  composition  of  those  sets  may  change,    it  is  useful 
to  be  able  to  display  the  changes  for  review  and  analysis. 

f.  FIND 

It  is  often  interesting  to  know  whether  or  not  a  move  other 
than  the  one  finally  implemented  was   generated  and  what  the  evaluation 
score  was.      FIND  performs  this  service. 

g.  PUTLIST  displays  the  entire  move  list,    or  a  specified  portion 
of  it. 

h.       SORTCT  restructures  a  player's  strategy  and  coefficient 
sets,    placing  the   10  largest  coefficients  and  the  corresponding  tactic 
identification  numbers  in  the  first  priority  level  of  each  strategy,    the 
next  10  largest  in  the  second  level,    and  so  on. 
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In  addition  to  these  subroutines,    ADMIN  contains  the  code  which 
performs  some  of  the  other  commands  available  to  the  user.     Among 
these  are  adjusting  coefficients  as  a  result  of  a  move  being  graded, 
evaluating  and  then  grading  in  arbitrary  move  entered  at  the  terminal 
during  a  training  session,    changing  the  trace  option,    and  changing  the 
DELTA  value  for  move  selection. 
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SAMPLE  COMPUTER  GAME 
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